Systems and methods for card-handling by point of sale devices

ABSTRACT

A computer vision card reader and/or point of sale device is described. The device is configured to sense when a user inserts a card into a card reader and to determine when a user departs or is about to depart from the device without retrieving the card. The device may issue an audible or visible alert to the user, reminding the user to retrieve the card. The device may additionally send a notification to a mobile device associated with the user that reminds the user that he has left a card at the point of sale. In some embodiments, message sent to the user contains a code and, upon entry of the code, the point of sale or card reader device returns the card to the user.

CROSS REFERENCE TO RELATED APPLICATION

The subject application is a Continuation of U.S. application Ser. No.16/394,208 filed Apr. 25, 2019, the contents of which is herebyincorporated by reference in its entirety.

FIELD OF THE INVENTION

This disclosure relates to point of sale device configured to alert auser if the user forgets or leaves a payment card or otheraccount-linked card in a point of sale device or card reader.

BACKGROUND

Automated Teller Machines (ATMs) and account-linked cards are useful forperforming several banking transactions and inquiries. Account-linkedcards have become commonplace, as many individuals use account-linkedcards such as those for access to membership club accounts, rewardsaccounts, gyms, parking facilities, secured buildings, accounts atbanking institutions, accounts for mass transportation and other typesof accounts. Account-linked cards are frequently used with card readersor devices equipped with card readers, some of which require the accountholder to insert the account-linked card containing information on amagnetic strip or embedded memory into the card reader. After the cardhas been read and authenticated, the account holder may be able to carryout a variety of transactions or inquiries.

The traditional manner of initiating a transaction or inquiry using anATM is to insert an account-linked card into a card reader, therebyallowing the card reader to receive information associated with a user'saccount from the card. In some instances, the card remains inserted inthe reader, or the ATM retains possession of the card, until the userhas completed a transaction. At that point, the user may be responsiblefor retrieving the card, or the ATM may present the card for the user totake. In some instances, the user may forget to retrieve the card fromthe card reader and may leave the area without the card. In thatsituation, some card readers are configured to ingest or swallow theaccount-linked card so that once the customer has left the area of thecard reader, the account-linked card is no longer accessible to preventpersons other than the account holder from obtaining the card.

When a card is ingested, this may cause significant inconvenience to theaccount holder. If a card reader has ingested a user's account-linkedcard, the user will no longer be able to use the account-linked card toaccess their accounts at the card reader or execute transactions usingthe card. Frequently, the user's only option for obtaining a workingaccount-linked card is to call the institution that issued theaccount-linked card, cancel the account-linked card, and order areplacement card to be sent through the mail. This process can be timeconsuming and leave the customer without sufficient access to theiraccounts.

This processes may also be costly to the institution that issued theaccount-linked card. The issuing institution must bear the cost ofcreating and shipping a replacement card for the user if the user is toresume utilizing the account-linked card. The institution also missesthe opportunity to collect fees associated with any transactions theuser is unable to perform during the period the use is without anaccount-linked card.

By applying automated, computer-based interpretation and/or analysis ofvisual information obtained with a camera, a card-reader device may beable to determine if a user has left or is about to leave an ATM, pointof sale (POS), or card reader without retrieving an account-linked card.Automated interpretation of video data may be known as computer vision.

What is needed is an ATM, point of sale (POS), or card reader devicewhich utilizes computer vision techniques to determine if a user hasleft or is about to leave an area without retrieving an account-linkedcard and notifies the user, reminding the user to take his card. Thissaves the user the inconvenience of going without an account-linked carduntil it is replaced and also saves the issuing institution the costs ofcreating and shipping a replacement card.

SUMMARY

Therefore, it is an object of this disclosure to describe a point ofsale, ATM, or card reader device which is configured to determine when auser is leaving or is no longer present at the ATM using computer visiontechniques.

It is a further object of the invention to describe a point of sale,ATM, or card reader which is configured to notify a user who has left anarea, or is in the process of leaving an area without retrieving anaccount-linked card.

Embodiments of the present disclosure provide a point of sale (POS)device comprising: a processor; a card sensor in data communication withthe processor, the card sensor configured to detect the presence of acard within the POS device and provide a card notification to theprocessor when the card is inserted into the POS device and removed fromthe POS device. Embodiments also comprise a camera in data communicationwith the processor, the camera configured to observe the presence andabsence of a user proximate to the POS device and provide a usernotification to the processor regarding the presence or absence of theuser. Upon receipt of a card notification from the card sensor that thecard is inserted into the POS device and receipt of a user notificationfrom the camera of the absence of the user, the processor is configuredto send a message to a communication device associated with the userindicating that the card is inserted into the POS device.

Embodiments of the present disclosure provide a user alert methodcomprising: detecting the presence of a user at a point of sale (POS)device using a camera in data communication with a processor. The camerais configured to observe the presence and movement of a user proximateto the POS device. The method comprises detecting the presence of a cardwithin the POS device using a card sensor in data communication with theprocessor, the card sensor configured to detect the presence of a cardwithin the POS device. The method further comprises determining when theuser moves away from the POS device using the processor and camera; andsending a message to a mobile device associated with the user upondetecting the presence of a card within the POS device and determiningthe user has moved away from the POS device.

Further features of the disclosed designs, and the advantages offeredthereby, are explained in greater detail hereinafter with reference tospecific example embodiments illustrated in the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a point of sale system according to an exampleembodiment.

FIG. 2 illustrates a card reader system according to an exampleembodiment.

FIG. 3 is a flow chart illustrating the operation of a disclosed ATMsystem according to an example embodiment.

FIG. 4 is a flow chart illustrating the operation of a disclosed ATMcomputer vision system according to an example embodiment.

FIG. 5 is a flow chart illustrating the operation of a disclosed POSsystem according to an example embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The following description of embodiments provides non-limitingrepresentative examples referencing numerals to particularly describefeatures and teachings of different aspects of the invention. Theembodiments and features described should be recognized as capable ofimplementation separately, or in combination, with other embodimentsfrom the description of the embodiments. A person of ordinary skill inthe art reviewing the description of embodiments should be able to learnand understand the different described aspects of the invention. Thedescription of embodiments should facilitate understanding of theinvention to such an extent that other implementations, not specificallycovered but within the knowledge of a person of skill in the art havingread the description of embodiments, would be understood to beconsistent with an application of the invention.

It will be understood that while some embodiments are disclosed in thecontext of an automated teller machine (ATM) or point of sale device(POS) for illustrative purposes, the present invention is not limited toATMs or point of sale devices. An ATM, POS, or other device equippedwith a card reader may be utilized in place of any other ATM, POS, orcard reader equipped device without limitation.

When a user utilizes an ATM, POS, or other device equipped with a cardreader, the user typically inserts an account-linked card into the cardreader. The card may contain information about the user personallyand/or the user's accounts. The card reader device typically reads thecard, authenticates the user, and initiates a transaction. A disclosedcard reader device utilizes computer vision and/or other techniques tomonitor the user and determine if the user has left the device withoutretrieving a card. In some embodiments, the device determines if theuser is indicating that the user is going to leave the device withoutretrieving the card. If the card reader device determines that the userhas left or is about to leave without retrieving his card, the devicealerts the user, prompting the user to retrieve the card. It will beappreciated that multiple types of card readers may be used with an ATM,POS, or kiosk. In some ATMs, the card reader is a slide-type card readerin which the user maintains possession of the card while sliding amagnetic stripe through the reader. In some ATMs, the card reader ischip reader device in which the user inserts a card but the card remainsphysically accessible to the user at all times. In some ATMs, the cardreader is an internal card reader. In such embodiments, a user inserts acard into the card reader and the card is taken into the ATM where it isphysically inaccessible to the user or any potential passers-by. In suchembodiments, the card may be retained within the ATM during atransaction, where it is physically inaccessible, and may then bepresented to the user once the transaction is complete.

FIG. 1 illustrates an exemplary embodiments of a disclosed point of sale(POS) device 105. In this exemplary embodiment, POS device 105 comprisesa processor 110, visual display 111, a card reader 113, a card sensor115, an output device 120, a currency sensor 125, distance sensingequipment 130, and a camera 135. It is understood that not allembodiments include every component of the exemplary embodiment of FIG.1 . It is also understood that, while FIG. 1 depicts a single instanceof each component, embodiments may contain multiple instances of anycomponents.

In some embodiments, card sensor 115 is in data communication withprocessor 110 and configured to detect the presence of a card within thePOS device 105. The card sensor 115 provides the processor with a cardnotification when a card is inserted into or removed from card reader113 and/or the POS device 105.

In some embodiments, the camera 135 may include, but is not limited to,a digital camera, video camera, a still camera, and/or other opticalimaging device. Camera 135 is in data communication with the processor110 and may be configured to observe the presence and absence of a userproximate to the POS device 105. The camera may be configured to providea user notification to the processor regarding the presence and/orabsence of a user. In some embodiments, the camera may be configured tomonitor the movements of a user to detect movements indicating the useris approaching and/or moving away from the POS device. In suchembodiments, the camera may send a user movement notification to theprocessor. In some embodiments, the camera may be configured to monitormovements of the user's head, body, arms, and/or hands to detectbehaviors indicating that the user is about to move away from the POSdevice.

In some embodiments, the disclosed processor includes a computer visionprocessor. It will be appreciated that the processor may be configuredto execute computer vision applications, programs, software, and/ortechniques which may be stored on local and/or remote servers and/ormemory. In some embodiments, if the processor receives a cardnotification from the card sensor indicating that a card is insertedinto the POS device and receives a user notification from the camera ora processor in communication with the camera indicating the absence ofthe user, the processor may send a message to a communication deviceassociated with the user indicating that the user's card is stillinserted in the POS device.

In some embodiments, the processor is configured to analyze visual dataprovided by the camera using facial recognition techniques. In someembodiments, the camera and/or processor may detect the presence of auser based on facial recognition.

In some embodiments, currency sensor 125 is configured to detect thepresence and/or absence of currency. This may indicate when the userretrieves currency which has been dispensed to the user. The currencysensor is in data communication with the processor and configured tosend a currency notification to the processor when the user removescurrency from the POS device. In some embodiments, the processor willnot send a message to the user until the currency sensor has indicatedthat the user has removed currency from the POS device.

In some embodiments, POS device 105 may be an ATM, kiosk, terminal, andor other device in which a user inserts an account-linked card or otherform of identification and/or information into a card reader.

In some embodiments, visual display 111 may include, but is not limitedto a standard video monitor, a touch screen display, a cathode ray tube,and/or LED display.

In some embodiments, the output device 120 may include but is notlimited to a speaker, siren, whistle, light, strobe light, and/orcombinations of the above. In some embodiments, the output device may bean input/output device such as, for example, a touch screen display.

In some embodiments, distance sensing equipment 130 may include, but isnot limited to laser range finders, LIDAR, RADAR, RGB-D cameras, and/orranging cameras.

An example embodiment of a system for alerting a user who has left anaccount-linked card in a card reader is shown in FIG. 2 . The system 200includes a card reader 205 which can read and authenticate anaccount-linked card 230. The card reader 205 is connected to a network220 which can be the Internet, a wide area network (WAN), or anothersuitable type of network. The card reader 205, like other elements ofsystem 200, may be connected to the network 220 via a wirelessconnection or a wired connection.

A server 210 may also be connected to the network 220. The server 210includes a processor and a memory for storing instructions executable bythe processor. The server 210 is capable of accessing a database 225which includes one or more storage media and stores various dataassociated with one or more accounts. As shown in FIG. 2 , the server210 may be connected directly to the database 225, though database 225could alternatively be incorporated within the server 210, accessed bythe server 210 via a network, or configured in any other suitable wayfor access by the server 210. Database 225 may additionally befunctionally distributed across two or more hardware units accessible bythe server 210.

The card reader 205 is a device capable of reading and authenticatingaccount-linking information stored on the account-linked card 230. Thecard reader 205 may include a display for displaying a graphical userinterface to a user and/or account holder. The card reader 205 mayfurther include a keypad, a keyboard, and/or a touch screen interface bywhich the account holder can input information. The card reader 205preferably includes a processor and a memory which stores instructionsfor execution by the processor.

The card reader 205 may include a slot or another receptacle forreceiving and reading the account-linking information stored on theaccount-linked card 230. The account-linked card 230 may be any securecard such as a magnetic strip card which stores account-linkinginformation in a magnetic strip, a smart card having an integratedcircuit and memory which stores account-linking information in thememory, or a card implementing radio frequency identificationtechnology.

In ordinary use, an account holder may insert her account-linked card230 into the card reader 205. The card reader 205 may then prompt theaccount holder via the graphical user interface on the display toauthenticate the account-linked card 230, for example, by entering apersonal identification number (PIN), or by other means. If successfullyauthenticated, the card reader 205 may display the account holder'saccount information to the account holder via the graphical userinterface and may also allow the account holder to make transactions.

In this example embodiments, when preparing to display accountinformation to the account holder, the card reader 205 sends a requestto the server 210, which may be in the form of an applicationprogramming interface (API) call, via the network 220 requesting accountinformation. The server 210 retrieves the requested information from thedatabase 225 and sends it back to the card reader 205 via the network220 for display to the account holder in the graphical user interface.

System 200 may also include a mobile device 215, which may be associatedwith the account holder of an account associated with the account-linkedcard 230. The mobile device 215 is suitable for receiving notificationssent by the server 210 via the network 220 relating to theaccount-linked card 230 or the account associated with theaccount-linked card 230. The mobile device 215 may be a smart phone orany other network connected device suitable for receiving notifications.

Exemplary embodiments may include one or more networks. In someexamples, the network 220 may be one or more of a wireless network, awired network or any combination of wireless network and wired network,and may be configured to connect a card reader and/or mobile device to aserver. For example, the network may include one or more of a fiberoptics network, a passive optical network, a cable network, an Internetnetwork, a satellite network, a wireless LAN, a Global System for MobileCommunication (GSM), a Personal Communication Service (PCS), a PersonalArea Network, Wireless Application Protocol (WAP), Multimedia MessagingService (MIMS), Enhanced Messaging Service (EMS), Short Message Service(SMS), Time Division Multiplexing (TDM) based systems, Code DivisionMultiple Access (CDMA) based systems, D-AMPS, Wi-Fi, Fixed WirelessData, IEEE 802.11b, 802.15.1, 802.11n and 802.11g, Bluetooth, Near FieldCommunication (NFC), Radio Frequency Identification (RFID), Wi-Fi,and/or the like.

In addition, the network may include, without limitation, telephonelines, fiber optics, IEEE Ethernet 902.3, a wide area network (WAN), awireless personal area network, a local area network (LAN), or a globalnetwork such as the Internet. In addition, the network may support anInternet network, a wireless communication network, a cellular network,or the like, or any combination thereof. The network may further includeone network, or any number of the exemplary types of networks mentionedabove, operating as a stand-alone network or in cooperation with eachother. The network may utilize one or more protocols of one or morenetwork elements to which they are communicatively coupled. The networkmay translate to or from other protocols to one or more protocols ofnetwork devices. Although the network 220 is depicted as a singlenetwork in FIG. 2 , it should be appreciated that according to one ormore examples, the network may comprise a plurality of interconnectednetworks, such as, for example, the Internet, a service provider'snetwork, a cable television network, corporate networks, such as creditcard association networks, and home networks

In some embodiments, the disclosed system may include one or moreservers. In some examples, servers may include one or more processors,which are coupled to memory. A server may be configured as a centralsystem, server or platform to control and call various data at differenttimes to execute a plurality of workflow actions. A server may beconfigured to connect to the one or more databases. A server may beconnected to at least one client device, communication device, and/ormobile device.

In some embodiments, the disclosed account-linked card is a paymentcard, such as a credit card, debit card, or gift card. Informationrelated to the issuer, card holder, and/or associated vendor may bedisplayed on the front or back of the card. In some examples, thepayment card may comprise a dual interface payment card. In someembodiments, the card is not related to a payment card, and maycomprise, without limitation, an identification card, security card,loyalty card, smart card, and/or access card.

In some embodiments, the camera may include but is not limited to adigital camera, video camera, still picture camera, and/or other imagingdevices. In some embodiments the camera may include, but is not limitedto, a thermal or infrared imaging device and/or presence detector suchas, for example, a proximity sensor, motion sensor, LIDAR detector,sonar, and/or distance sensing equipment. It will be appreciated thatthe term “camera” is not limited to conventional optical imagingdevices. In some embodiments, one or a plurality of cameras may containan integral processor and/or be operably connected to a processorconfigured for computer vision.

In some embodiments, the camera is positioned to view a user inserting acard into a card reader. The camera is operably connected to a processorwhich is configured to receive visual data from the camera and analyzethe visual data in order to make determinations. This automated processmay be referred to as computer vision. In some embodiments, the camerais maintained in a fixed position and is not configured to pan, tilt, orzoom. This may increase the accuracy of a computer vision system as afixed position camera may have a substantially static background. Itwill be understood that in some embodiments, a static background may betemporarily obscured by a significant number of moving objects, such as,for example, vehicle and/or pedestrian traffic.

In some embodiments, the camera and/or computer vision processor may beconfigured to establish a background over time. For example, a buildingin view of the camera may be renovated over time. By allowing a computervision system to periodically update and/or average a background image,the computer vision system may be configured to adapt to changes in thebackground in order to reduce and/or eliminate false alerts.

In some embodiments, the processor is configured to perform automatedinterpretation of visual data received from the camera in real time. Insome embodiments, multiple sources of visual data, such as cameras,video cameras, and/or other optical devices may be used. In someembodiments, utilizing multiple cameras, or sources of visual data whichare positioned to view the same or similar scene from different anglesmay allow the computer vision system to make more accuratedeterminations regarding the location and/or movement of an object, suchas, for example, a user. In some embodiments, utilizing two or morecameras positioned to view the same or similar scene from substantiallythe same angle may allow the computer vision system to utilize stereovision techniques in order to make more accurate determinationsregarding the location and/or movement of an object.

In some embodiments, a camera may contain or be connected to a processorwhich performs user detection on the scene viewed by that camera and maygenerate a “bounding box” (or other additional information) for a userin a frame. In some embodiments, a processor may generate a bounding boxfor individual portions of the user including, but not limited to theuser's arms, head, torso, and/or hands. In some embodiments, theprocessor may generate a bounding box for the user's purse and/orwallet.

In some embodiments, a camera may transmit bounding box data to aprocessor, which aggregates possible user data from multiple cameras.Such embodiments may allow the processor to more accurately determineuser presence and/or determine when a user is indicating that she isabout to leave an area. The use of multiple cameras may increase theoverall accuracy and effectiveness of the system utilizing triangulationand/or false-alarm rejection.

The process of user detection may include one or a plurality of computervision and/or feature detection algorithms including, but not limited toa histogram of oriented gradients (HOG), integral channel features(ICF), aggregated channel features (ACF), and/or deformable part models(DPM). In some embodiments, tracking algorithms may also be utilizedincluding, but not limited to Kalman filters, particle filters, and/orMarkov chain Monte Carlo (MCMC) tracking approaches.

Different algorithms may provide unique performance characteristics interms of accurately detecting a user and/or user movements as wellavoiding false alarms. Each computer vision and/or feature detectionapproach may also provide differing performance characteristics based onthe lighting and/or other visual characteristics of a particulardeployment.

In some embodiments, user and/or object detections can be aggregatedtemporally within a camera and/or processor to reduce false alarms andimprove the probability of detection by keeping track of person and/orobject detection confidences over time within a camera view. This mayreduce or prevent false alarms and improve the reliability of theover-all system.

In some embodiments, computer vision determinations may be utilized incombination with a predictive model in order to determine theprobability of a user departing from a card reader device withoutretrieving a card. The predictive model may be developed based onhistorical information related to use of a card reader device. Suchinformation may include, but is not limited to, user position, userspeed, user movements, and/or an identified sequence of transactionsteps and/or user behaviors.

In one non-limiting example, a predictive model may be developed basedon the length of time a user utilizes an ATM before retrieving theircard and/or departing from the ATM. A predictive model may understandthat most users utilize an ATM for a single transaction that lastsapproximately 90 seconds and involves a particular sequence oftransaction steps. Using this information, the predictive model mayreject indicators that a user is going to leave an area in significantlyless than 90 seconds after the user has inserted a card into the ATM.For example, it is unlikely a user would depart from an ATM within thefirst ten seconds of initiating a transaction. In some embodiments, thedisclosed predictive model may be used as a confirmation to limit thenumber of false alarms generated by a computer vision processor.

In some embodiments, a computer model and/or predictive model mayincorporate variables related to the position and/or movements of auser. For example, a predictive model and/or computer model may observeuser position and/or user movements using a camera and computer visionprocessor in order to develop a model of positions, movements, and/orbehaviors which precede the user leaving the ATM. In some embodiments,the computer model may include variables relating to a sequence of userpositions or movements.

The disclosed system may include multiple and/or redundant systems. Insome embodiments a processor aggregates input from a computer visionsystem as well as a predictive model in order to make a determination ofwhether a user has departed or is about to depart from an ATM withoutretrieving a card which has been inserted into a card reader.

In some embodiments, a card reader device may be configured to executemultiple computer vision and/or facial recognition techniques. Suchembodiments may determine which technique or combination of techniquesis most effective once the physical system has been installed at aparticular location. In some embodiments, the disclosed system mayinclude a training routine or initialization program designed todetermine which of a plurality of computer vision and/or facialrecognition techniques is best suited for a particular application.

In one non-limiting example, using object detection and/or boundingboxes to keep track of a person detected using facial detection orfacial recognition techniques may reduce false alarms or inaccuratedetection of a user. If the user turns, bends, or otherwise obscurestheir face temporarily, some embodiments may use object detection and/orbounding boxes to continue to track the user despite being unable toclearly view the user's face. Some embodiments may use object permanencelogic and/or encoded rules in order to avoid confusing a detected userwith a different individual who may also be in view of the computervision system. It will be appreciated that facial detection techniquesmay be utilized to detect the presence of a face and facial recognitiontechniques may be utilized in order to identify, track, or monitor aparticular user's face.

In some embodiments, computer vision information may be screened inorder to reduce and/or limit inaccurate information. In one,non-limiting example, human motion is known to occur within reasonablelimitations. In some embodiments, a computer vision system may monitorthe speed at which a user approaches or departs from an ATM. If acomputer vision system determines that a user has approached or departedfrom the ATM at a speed outside the reasonable limits on human movement,this information may be flagged or rejected. In one non-limitingembodiments, if the average speed at which a user approaches or departsfrom an ATM is determined to be approximately 3 miles per hour.Therefore, any report of a user approaching or departing from an ATM atgreater than 10 miles per hour likely represents an inaccurate report.

Using the systems, methods, and techniques disclosed herein, acard-reader device, point of sale, and/or ATM is able to alert a userwho departs from a card reader without retrieving a card. By alertingand/or notifying a user who has left, or is about to leave an areawithout retrieving a card, the user can be reminded to retrieve thecard, thereby saving both the user and the card issuer the cost andinconvenience of replacing the card.

In one example embodiment, a user approaches an ATM equipped with acamera which is in data communication with a computer vision processor.The user inserts a card into the card reader in order to initiate atransaction. The card sensor transmits a signal to the processor that acard has been inserted into the card reader. The camera is configured toobserve the user and/or the user's movements while the user is at theATM. The user follows the graphical user interface prompts in order toperform the desired transaction. In this example, the transactioninvolves the user withdrawing currency from the ATM. Once the user hasretrieved the currency from the ATM, the user turns to walk away. Thecamera and computer vision processor are configured to capture andinterpret visual data showing the user turning and then walking awayfrom the ATM. The processor is in data communication with the cardsensor, which indicates that the card has not been retrieved from thecard reader. Once the processor determines that the user is leaving thearea and has not retrieved the card, the processor initiates a usernotification.

In some embodiments, an example notification may include, but is notlimited to an audible alert issued by an output device. The ATM mayinclude a speaker which is configured to beep, whistle, or issue anaudible statement, informing the user that she has not retrieved hercard. As an example, the output device may be configured to issue thestatement “Don't Forget Your Card” when the processor determines thatthe user is leaving the ATM and has not retrieved her card.

In some embodiments, the processor, which is operably connected to thecard reader, may cause the output device to include the user's firstname, last name, and/or full name as part of an issued statement. Thecard reader may read the user's name stored on the account-linked card,and transmit the user's name to the processor. The processor may thencause the output device to issue a personalized audible alert such as,for example, issuing the statement “Jane Smith, Don't Forget Your Card.”

In some embodiments, in addition to an immediate audible alert, the ATMmay be configured to activate a light, strobe, whistle, beep, and/orsiren to get the user's attention and remind the user to retrieve hercard.

In some embodiments, the camera observes the user after the audiblenotification has been issued to determine if the user returns to the ATMand retrieves the card. If the user does not return to retrieve thecard, or if the user does not retrieve the card within a predeterminedtime period, the processor may be configured to send a notification to amobile device associated with the user. In such embodiments, theprocessor may instruct a network connected server to send a textmessage, SMS, and/or phone message to one or a plurality of mobiledevices associated with the user and/or account holder based oninformation stored on the card. In some embodiments, the ATM mayadditionally or alternatively send an email to one or a plurality ofemail address associated with the user based on information stored onthe card. In some embodiments, if the user does not return to retrievethe card, or if the user does not retrieve the card within apredetermined time period, the processor may be configured the instructa digital wallet application or other application associated with theuser to issue an alarm such as, for example, an audible notification, asiren, a vibration, or a strobe light.

FIG. 3 shows a method 300 of utilizing a card reader, ATM, and/or POSdevice in order to alert a user who has failed to retrieve a card. Atstep 305, a user approaches the ATM. As the user approaches the ATM, theuser enters the field of view of a camera. At step 310, the user insertsan account-linked card into the card reader of the ATM. In someembodiments, the ATM registers the presence of the card using a cardsensor. The user may be prompted to enter a PIN or other authenticationby the user interface of the ATM and then be allowed to perform varioustransactions using the account associated with the user's account-linkedcard. In step 315, the camera collects visual data regarding the userand transmits visual data to a computer vision processor. In step 320,the processor analyzes the visual data and determines, in step 325, thatthe user has departed from the ATM. The processor may also determine,using computer vision or a card sensor, in step 330, if the user hasretrieved her card. If the user has already retrieved her card, in step335, the ATM may determine that no further action is required. If theuser has not retrieved her card, in step 340, the ATM issues an initialnotification reminding the user to retrieve her card. The initialnotification may be a statement including the user's name. In step 345,the ATM transmits a reminder notification to a communication deviceand/or mobile device associated with the user. In some embodiments, theATM may use a chip card reader which leaves the card physicallyaccessible to the user or any passers-by in the area. In step 350, ifthe user has not retrieved her card, the card may be deactivated toprevent someone other than the user from obtaining and using the card.

In some embodiments, the disclosed ATM or other card reader device maysend a code to the user's mobile device and/or email address. The ATMmay retain the user's card so that the card is physically inaccessibleto the user or any passers-by for a predetermined period of time aftersending the message. If the user returns to the ATM within apredetermined period of time, the user may be able to enter the code inorder to retrieve the card. In such embodiments, upon receiving thecode, the ATM may present the card to the user, allowing the user tophysically access the card again. In some embodiments, the ATM maymaintain the user's transaction session for a predetermined period oftime. In some embodiments, the camera is configured to detect thepresence of a user based on facial recognition and the processor isconfigured to end a user's transaction session upon recognition of adifferent user proximate to the ATM. This may allow the ATM to maintaina transaction session open and facilitate the return of a user's cardfor as long as possible without allowing a subsequent user to interactwith the user's account through an open transaction session.

In some embodiments, if the user does not return to the ATM within apredetermined period of time, the ATM may ingest the card. In manyembodiments, once the card is ingested, it may be destroyed or mayotherwise be un-retrievable by the user.

In some embodiments, the ATM may be configured to extend a given timeperiod prior to ingesting the card if the user responds to a notice sentto the user's mobile device. In an example, the ATM may be configured toissue an audible warning and send a notice to the user's mobile deviceupon determining that the user has left the ATM without retrieving hercard. The ATM may then initiate, for example, a two-minute time period,after which the card will be ingested. This two-minute time period maybe designed to allow the user to hear the audible alert and/or check hermobile device and return to the ATM prior to the card being ingested. Insome embodiments, the two-minute window may be extended if the userresponds to the message sent to her mobile device. For example, if theuser responds to the message within 90 seconds, the ATM may extend thetime window for an additional five minutes. This may allow the user tonotice the message and respond, indicating that the user will return tothe ATM even if the user is unable to return to the ATM within theoriginal time window. It will be understood that the time period priorto ingesting a card, as well as the time period for allowing a user toreturn may be any pre-determined time period. Additionally, each timeperiod may be extendable by any amount. The example embodiments are notintended to be limiting on these potential features.

In some embodiments, the user may be able to respond to the noticeindicating that the user will return to the ATM at a specific time inthe future, thereby creating a window of a predetermined duration at alater time.

In some embodiments, the ATM may be equipped with a temporary cardstorage which allows the ATM to resume normal operations whilemaintaining possession of a user's un-retrieved card without ingestingthe card. In such embodiments, the ATM may be configured to return thecard to a user who enters a code sent to the user's mobile device and/oremail. In some embodiments, the ATM may confirm the user retrieving thecard is the same user who abandoned the card using facial recognitiontechniques. In some embodiments, the ATM may send a second code to theuser upon entry of the initial code. The second code may be designed tobe active for a limited time window, such as, for example, less than oneminute. This may help to ensure that the user attempting to retrieve theabandoned card is in physical possession of the user's mobile deviceand/or has real-time access to the user's email, thereby reducing theability of a third party to intercept any code sent from the ATM to theuser and fraudulently obtain the user's card. If the user does notreturn to the ATM after a pre-determined period of time, the ATM isdesigned to ingest the card, thereby making the card un-retrievable.

In some embodiments, the ATM may utilize facial recognition techniquesin order to compare the user attempting to retrieve the card with theuser who initially abandoned the card. The ATM may additionally oralternatively utilize facial recognition techniques to compare the userattempting to retrieving the card to a facial recognition profile of anauthorized user associated with the card. In some embodiments, only theauthorized user, who is confirmed using facial recognition, may beallowed to utilize the card to initiate a transaction. This may be anadded security feature in addition to requiring the user to enter a pinnumber or other form of password.

In addition to utilizing computer vision techniques, disclosed systems,ATMs, POSs, and card readers may be equipped with distance sensingequipment. In some example embodiments, the distance sensing equipmentmay be configured to be aimed at an individual user rather thanmaintained in a fixed positions. The distance sensing equipment may bein data communication with a processor. In some embodiments, thedistance sensing equipment may be used to determine when a user isleaving an ATM.

In an example embodiment, when a user approaches an ATM and initiates atransaction, the user's torso will occupy a significant portion of afield of view of any cameras and distance sensing equipment mounted onthe ATM. In addition to the computer vision techniques described herein,distance sensing equipment may be used to directly measure how far theuser is from the ATM. While the user is utilizing the ATM, the user willbe within a certain distance range such as, for example, between 1 and 3feet away. If the user moves further from the ATM, as measured usingdistance sensing equipment, the distance sensing equipment may informthe processor that the user is leaving the ATM. The distance sensingequipment may transmit data to the processor indicating the user'sdistance from the ATM. This may allow the processor to determine if theuser is actually leaving the area or if the user has merely taken asmall step back. In some embodiments, the processor may use informationfrom the distance sensing equipment in order to corroborate, verify,and/or confirm determinations made using computer vision techniques.

In some embodiments, the processor may be able to determine the rateand/or direction at which the user is departing the area. The processormay adjust the volume and/or timing of any alert issued by the ATM orsent to the user based on these determinations.

In some embodiments, when the ATM determines that the user has departedfrom the ATM without retrieving the user's card, the ATM may close anyopen dialog windows, thereby preventing anyone other than the originaluser from accessing the user's account if the user walks away withoutcompleting a transaction.

In some embodiments, the ATM, POS, and/or card reader device may beoperably connected to a weight sensor. In some embodiments, the weightsensor is a pad positioned directly in front of an ATM, so that a userof the ATM stands on the weight sensor. The weight sensor may beconfigured to provide a notification to the processor when a user isstanding on the weight sensor and/or when a user steps off of the weightsensor. This may provide additional corroboration, verification, and/orconfirmation of any determination made using the disclosed computervision techniques.

In some embodiments, the disclosed computer vision system may beconfigured to detect movements, behaviors, and/or features whichindicate a user is about to leave an area before the user has actuallyleft.

If a processor determines that a user is preparing to leave an ATM buthas not retrieved a card, the system may issue an early notificationreminding the user to retrieve her card. In some cases, this earlynotice reminds the user to take her card and eliminates the need to senda message to a mobile device associated with the user after the user hasleft the ATM without retrieving the card.

In some embodiments, the disclosed systems may utilize computer visionin order to observe the movements and/or position of a user includingmovements of the user's hands, arms, torso, and/or head. By observingthe user's movements, the ATM may be able to develop and/or refine acomputer model and/or database of motions or behaviors that precede theuser departing from the ATM.

For example, if a user rotates her head and torso, so that the user isfacing away from the ATM but has not retrieved her card, the processormay determine that the user is in the process of departing from the ATMwithout retrieving her card. This determination may be made even if theuser is still in close proximity to the ATM. In such cases, an audibleand/or visual alert reminding the user to retrieve her card may be veryeffective. If the user starts walking away, a second audible alert maybe issued. In some embodiments, the second audible alert may include adifferent tone, pitch, or statement, and/or be issued at a greatervolume that an initial audible alert. If the user does not respond tothe audible alerts, the ATM may send a notification to the user's mobiledevice, reminding the user to return to the ATM and retrieve her card.

In some embodiments, facial recognition techniques may be used todetermine when a user rotates her head in order to predict when a useris likely to leave an ATM. This may be used in addition to or instead ofother techniques for determining when a user is leaving an ATM which aredescribed herein.

In another example, a user's movements may be observed to determine thata user has retrieved currency from the ATM and inserted the currencyinto a purse and/or wallet. The ATM may determine that this behaviorprecedes the user departing from the ATM. If the user does not retrieveher card within a certain time period of inserting currency into herpurse and/or wallet, the ATM may issue an audible warning reminding theuser to retrieve her card.

In some embodiments, an ATM with computer vision capabilities describedherein, may develop a library of intent to leave behaviors based onobservations of movement and/or behaviors which occur at the ATM. Forexample, an ATM may be configured to observe all ATM users and recordinformation related to the user movements, timing, and sequentialtransaction steps. Over time, the ATM may generate a strong associationbetween a user retrieving currency, putting the currency in her wallet,retrieving a card, and then, approximately 10 seconds later, departingfrom the ATM. If an ATM observes a user's arm movements and determinesthat the user has retrieved currency and put it in her wallet, but hasnot yet retrieved the user's card after a predetermined time period. TheATM may elect to issue a notification reminding the user to retrieve hercard.

In some embodiments, the ATM may develop a library of other behaviorswhich are associated with departing the ATM without retrieving a cardand issue an initial notification reminding users to retrieve theircards.

In some embodiments, the ATM may observe which notifications areeffective at causing the user to notice and return to retrieve a card.Over time, the ATM may refine the notifications in order to improve theresponse rate. Such refinements may include, for example, changing thevolume, pitch, and/or tone of a notification and/or changing the contentand/or timing of an issued statement.

In some embodiments, an ATM may determine that particularcharacteristics of users are more likely to respond to differentnotifications. In such embodiments, the ATM may utilize a user'scharacteristics such as by information stored on the user's card andadjust any notifications in order to most effectively remind the user toretrieve a card. For example, over time, an ATM may determine that auser responds most consistently to issued statements which begin withthe user's first name. Some embodiments may also determine that otherusers respond most consistently to issued statements which begin withthe user's full name. Based on such determinations, a personalizedaudible warning may be generated for individual users.

FIG. 4 shows an example embodiment of a method 400 of notifying a userwho has departed from an ATM without retrieving a card. At step 405, auser approaches the ATM. As the user approaches the ATM, the user entersthe field of view of a camera and distance sensing equipment. At step410, the user inserts an account-linked card into the card reader of theATM. In some embodiments, the ATM registers the presence or absence ofthe card directly using a card sensor. The user may be prompted to entera PIN or other authentication by the user interface of the ATM and thenbe allowed to perform various transactions using the account associatedwith the account-linked card. In step 415, the camera collects visualdata regarding the user and transmits visual data to a computer visionprocessor. In step 420, the processor analyzes the visual data anddetermines if the user has displayed any intent to leave behaviors suchas, for example, inserting currency into a wallet or purse, placing anyitems in the user's pockets, operating a mobile device, and/or turningaway from the ATM. In step 425, the ATM determines that the user hasdisplayed an intent to leave behavior. In step 430, the processor maydetermine whether or not the user has retrieved her card. The processormay determine whether the user has retrieved her card using computervision or may utilize the card sensor to determine if the user hasretrieved her card. If the user has already retrieved her card, in step435, the ATM determines that no reminder notification is necessary. Ifthe user has not retrieved her card, in step 440, the ATM may issue aninitial notification reminding the user to retrieve her card. In step445, the ATM may continue to observe the user using a camera after theinitial notice is issued. In step 450, the ATM again determines whetheror not the user has retrieved her card. If the user retrieves her card,the ATM may determine that no subsequent notifications are required. Ifthe user departs from the ATM without retrieving her card, in step 455,the ATM may issue a second audible and/or visual notification and/or maytransmit a notification to a mobile device associated with the user.

FIG. 5 shows an example embodiment of a user alert method 500 utilizinga point of sale device. In step 505, the method comprises detecting thepresence of a user at the POS device using a camera which is in datacommunication with a computer vision processor. The camera is configuredto observe the presence and movement of a user who is approaching and/orproximate to the POS device. In step 510 the POS detects the presence ofa card within the POS device using a card sensor which is in datacommunication with the processor. The card sensor is configured todetect the presence and/or absence of a card within the POS device. Instep 515, the POS device determines when the user moves away from thePOS device using the processor and camera. In step 520, if the POSdevice detects the presence of a card within the POS device anddetermines that the user has moved away from the POS device, the POSdevice sends a message to a mobile device associated with the user.

In some embodiments, method 500 also includes, in step 525, determiningwhen and/or if a user has removed currency from the POS device. Thisdetermination may be performed using a currency sensor or may beperformed using computer vision. When computer vision is used todetermine if a user has removed currency from the POS device, the cameraobserves the user's movements and relays the visual information to thecomputer vision processor. The computer vision processor may beconfigured to interpret the user's movements and may also be configuredto extract the feature of currency from the visual data provided by thecamera.

In some embodiments, method 500 also comprises, the steps of 530determining when a user turns her body away from the POS device and 535issuing an audible notification when a user turns away. In some cases,this initial notification will alert the user to the fact she has notretrieved her card and prevent the user from departing the area withoutthe card.

In some embodiments, method 500 also comprises the step of 540 recordingthe number of events in which a particular user has moved away from thePOS device while a card was inserted in the POS device. Over time, thePOS may develop a profile and/or score associated with users who aremore likely to leave the POS without retrieving their cards. If the POSdetermines that a user has a history of leaving the POS withoutretrieving her card, the POS may adjust operation of the user interfacein order to remind the user to retrieve her card before the usercompletes a transaction.

If the user departs from the POS device without retrieving her card, instep 545, the POS may retain the card for a predetermined retainmenttime period. If the user responds to the message indicating that thatshe has left her card at the POS on her mobile device, in step 550 thePOS device may extend the retainment period. In some embodiments, oncethe retainment period expires, in step 555, the POS ingests the card.

The present disclosure is not to be limited in terms of the particularembodiments described in this application, which are intended asillustrations of various aspects. Many modifications and variations canbe made without departing from its spirit and scope, as may be apparent.Functionally equivalent methods and apparatuses within the scope of thedisclosure, in addition to those enumerated herein, may be apparent fromthe foregoing representative descriptions. Such modifications andvariations are intended to fall within the scope of the appendedrepresentative claims. The present disclosure is to be limited only bythe terms of the appended representative claims, along with the fullscope of equivalents to which such representative claims are entitled.It is also to be understood that the terminology used herein is for thepurpose of describing particular embodiments only, and is not intendedto be limiting.

The foregoing description, along with its associated embodiments, hasbeen presented for purposes of illustration only. It is not exhaustiveand does not limit the invention to the precise form disclosed. Thoseskilled in the art may appreciate from the foregoing description thatmodifications and variations are possible in light of the aboveteachings or may be acquired from practicing the disclosed embodiments.For example, the steps described need not be performed in the samesequence discussed or with the same degree of separation. Likewisevarious steps may be omitted, repeated, or combined, as necessary, toachieve the same or similar objectives. Accordingly, the invention isnot limited to the above-described embodiments, but instead is definedby the appended claims in light of their full scope of equivalents.

In the preceding specification, various preferred embodiments have beendescribed with references to the accompanying drawings. It may, however,be evident that various modifications and changes may be made thereto,and additional embodiments may be implemented, without departing fromthe broader scope of the invention as set forth in the claims thatfollow. The specification and drawings are accordingly to be regarded asan illustrative rather than restrictive sense.

What is claimed is:
 1. A point of sale (POS) device comprising: a cardreader configured for insertion and return of a card and for entry of acode; and a processor in data communication with the card reader, afirst sensor, and a second sensor, wherein the processor is configuredto: receive a first notification from the first sensor, receive a secondnotification from the second sensor, transmit a message indicating acard insertion, the message including a message code, maintain atransaction session for a period of time following the transmission ofthe message, and upon receipt of a third notification from the cardreader, instruct the card reader to return the card.
 2. The POS deviceof claim 1, wherein: first sensor is a card sensor configured to detectthe insertion and release of the card, and the first notificationindicates when the card has been inserted into the card reader.
 3. ThePOS device of claim 1, wherein: the second sensor is a camera configuredobserve the presence and absence of a user proximate to the POS device,and the second notification indicates the presence or absence of theuser.
 4. The POS device of claim 3, wherein the camera is configured to:determine when the user performs a head rotation; and transmit thesecond notification indicating the absence of the user.
 5. The POSdevice of claim 3, wherein: the camera is further configured to, upondetection of the presence of a user proximate to the POS device, monitorthe movement of the user for one or more movement indications showingthe user may be moving away from the POS device, wherein the one or moreuser movement indications include at least one selected from the groupof the user moving away from the POS device, the user inserting an iteminto a pocket, the user inserting an item into a bag, and the useroperating a mobile device, and the camera is further configured to, upondetection of one or more movement indications, send a user movementnotification to the processor.
 6. The POS device of claim 5, wherein:the POS device includes an output device, and the processor is furtherconfigured to, upon receipt of a user movement notification, present atleast one selected from the group of an audible notice and a visualnotice via the output device.
 7. The POS device of claim 6, wherein: theoutput device is a speaker, and the audible notice includes the firstname listed on the card.
 8. The POS device of claim 1, wherein: thethird notification is a code entry message comprising an entered code,and prior to instructing the card reader to return the card, theprocessor is configured to determine whether the entered code matchesthe message code.
 9. The POS device of claim 1, wherein the camera isconfigured to detect the presence of a user based on facial detection.10. The POS device of claim 9, wherein: the camera is configured totransmit the facial detection to the processor, and the processor isconfigured to compare the facial detection to a facial recognitionprofile of an authorized user associated with the card.
 11. The POSdevice of claim 10, wherein the processor is configured to transmit themessage only upon a successful comparison of the facial detection to thefacial recognition profile.
 12. The POS device of claim 10, wherein theprocessor is configured to end the transaction session upon anunsuccessful comparison of the facial detection to the facialrecognition profile.
 13. The POS device of claim 10, wherein the POSdevice is configured to ingest the card upon an unsuccessful comparisonof the facial detection to the facial recognition profile.
 14. The POSdevice of claim 1, wherein: the POS device further comprises a currencysensor configured to send a currency notification to the processor thata form of currency has been removed from the POS device, and theprocessor is configured to send the message after receiving a currencynotification from the currency sensor.
 15. The POS device of claim 1,wherein the POS device is configured to ingest the card after the periodof time expires.
 16. A user alert method, the method comprising:detecting, by a first sensor, a card insertion into a card reader;transmitting, by the first sensor, a first notification to a processor,wherein the first notification indicates the card insertion; detecting,by a second sensor, the presence of a user within a vicinity of thesecond sensor; transmitting, by the second sensor, a second notificationto the processor, wherein the second notification indicates the presenceof the user; initiating, by the processor, a transaction session uponreceipt of the first notification and the second notification;detecting, by a second sensor, the absence of the user within thevicinity of the second sensor; transmitting, by the second sensor, athird notification to the processor, wherein the third notificationindicates the absence of the user; transmitting, by the processor, amessage indicating the card insertion upon receipt of the thirdnotification, the message including a code; maintaining, by theprocessor, the transaction session for a period of time following thetransmission of the message; receiving, by the card reader, entry of thecode; transmitting, by the card reader, a fourth notification to theprocessor, wherein the fourth notification indicates the entry of thecode; and instructing, by the processor, the card reader to release thecard.
 17. The method of claim 16, further comprising: prior toinstructing the card reader to release the card, transmitting, by thesecond sensor, a fifth notification to the processor, wherein the fifthnotification indicates the presence of the user within the vicinity ofthe second sensor.
 18. The method of claim 17, wherein the second sensorconfirms, via facial detection, that the user within the vicinity of thesecond sensor is an authorized user prior to transmitting the fifthnotification.
 19. The method of claim 16, further comprising extending,by the processor, the transaction session for a second period of timeupon receipt of the fourth notification.
 20. A card reader comprising: aslot for insertion and removal of a card, the slot configured to retainthe card until the conclusion of a transaction session; a card sensorconfigured to determine whether the card has been inserted into the slotand whether the card has been removed from the slot; and an input deviceconfigured to receive the entry of a code, wherein: upon determining theinsertion of the card into the slot, the card sensor is configured totransmit a first notification indicating the insertion of the card, uponreceipt of the entry of the code by the input device, the card reader isconfigured to transmit a second notification indicating receipt of theentry of the code, and upon receipt of a third notification extendingthe transaction session for a period of time, the card reader isconfigured to retain the card for the period of time.